Methods, systems, and devices for improved skin temperature monitoring

ABSTRACT

The present disclosure provides computer-implemented methods, systems, and devices for improved skin temperature monitoring. Accurate estimates of skin and ambient temperature are generated based on determinations and comparisons of skin and internal device temperature sensor measurements contained on or within example devices. The estimates of skin and ambient temperature measurements facilitate monitoring skin and core temperature changes, detecting physiological events of a wearer of example devices, and determining when skin temperature changes are environmentally or physiologically induced.

FIELD

The present disclosure relates generally to health monitoring andwearable devices for health monitoring. More particularly, the presentdisclosure relates to methods and devices for improved skin temperaturemonitoring.

BACKGROUND

Skin temperature data can be dominated by shifts in ambient temperature.Devices that provide for skin temperature monitoring can thus introduceinaccuracies that are unrelated to sensor error. Methods, systems, anddevices are needed to distinguish skin temperature changes that arephysiologically induced from skin temperature changes that areenvironmentally induced.

SUMMARY

Aspects and advantages of embodiments of the present disclosure will beset forth in part in the following description, or can be learned fromthe description, or can be learned through practice of the embodiments.

One example aspect of the present disclosure is directed to acomputer-implemented method for providing improved skin temperaturemonitoring. The method comprises determining, by a computing systemcomprising one or more computing devices, an internal device temperatureof a wearable device worn by a user based on sensor data received froman internal device temperature sensor contained within the wearabledevice. The method also comprises determining, by the computing system,a first estimate of a skin temperature of the user based on sensor datareceived from a skin temperature sensor contained on or within thewearable device. Next, the method involves estimating, by the computingsystem, an ambient air temperature based at least in part on the firstestimate of the skin temperature and the internal device temperature.The method then comprises refining, by the computing system, the firstestimate of the skin temperature based at least in part on the estimatedambient air temperature to generate a second estimate of the skintemperature.

Another example aspect of the present disclosure is directed to awearable device, comprising a device housing configured to be worn by auser, one or more processors included within the device housing, one ormore skin temperature sensors included on or within the device housingand configured to produce skin temperature sensor data, one or moreinternal device temperature sensors included within the device housingand configured to produce internal device temperature sensor data,non-transitory computer-readable memory included within the devicehousing and storing instructions that, when executed by the one or moreprocessors, cause the wearable device to perform operations. Inparticular, the operations comprise determining an internal devicetemperature within the device housing based at least in part on theinternal device temperature sensor data received from the one or moreinternal device temperature sensors contained within the wearabledevice; determining a first estimate of a skin temperature of the userbased on sensor data received from a skin temperature sensor included onor within the device housing; estimating an ambient air temperaturebased at least in part on the first estimate of the skin temperature andthe internal device temperature; and refining the first estimate of theskin temperature based at least in part on the estimated ambient airtemperature to generate a second estimate of the skin temperature.

Another example aspect of the present disclosure is directed to acomputer-implemented method for providing improved skin temperaturemonitoring. The method comprises determining, by a computing systemcomprising one or more computing devices, an internal device temperatureof a wearable device worn by a user based on sensor data received froman internal device temperature sensor contained within the wearabledevice. Next, the method comprises determining, by the computing system,a first estimate of a skin temperature of the user based on sensor datareceived from a skin temperature included on or within the wearabledevice. The method next involves refining, by the computing system, thefirst estimate of the skin temperature based at least in part on theinternal device temperature of the wearable device to generate a secondestimate of the skin temperature. The method then comprises determining,by the computing system, one or more physiological events based at leastin part on the second estimate of the skin temperature.

BRIEF DESCRIPTION OF THE DRAWINGS

Detailed discussion of embodiments directed to one of ordinary skill inthe art is set forth in the specification, which makes reference to theappended figures, in which:

FIG. 1 depicts a front view of an example wearable device according toexample embodiments of the present disclosure.

FIG. 2 depicts a rear view of an example wearable device according toexample embodiments of the present disclosure.

FIG. 3 depicts a side internal view of an example wearable deviceshowing an internal device temperature sensor contained within a housingaccording to example embodiments of the present disclosure.

FIG. 4 depicts a side internal view of an example wearable deviceshowing a skin temperature sensor contained within a housing accordingto example embodiments of the present disclosure.

FIG. 5 depicts a flow of steps of an example skin temperature denoisingmethod according to example embodiments of the present disclosure.

FIG. 6 depicts an example physiological events detection systemaccording to example embodiments of the present disclosure.

FIG. 7 depicts another example of a physiological events detectionsystem according to example embodiments of the present disclosure.

FIG. 8 depicts another example of a physiological events detectionsystem according to example embodiments of the present disclosure.

FIG. 9 depicts an example computing system according to exampleembodiments of the present disclosure.

FIG. 10 depicts a graph of example temperature data of a wearable deviceaccording to example embodiments of the present disclosure.

FIG. 11 depicts a graph of example internal device and skin temperaturesensor data of a wearable device according to example embodiments of thepresent disclosure.

FIG. 12 depicts a graph of example internal device and skin temperaturedifferential data according to example embodiments of the presentdisclosure.

FIG. 13 depicts a graph of example temperature data of multiple wearabledevices according to example embodiments of the present disclosure.

FIG. 14 depicts a graph illustrating an example linear regression modelof ambient temperature estimate predictions according to exampleembodiments of the present disclosure.

FIG. 15 depicts a graph of example skin temperature variations inrelation to a number of days from a fever according to exampleembodiments of the present disclosure.

FIG. 16 depicts a graph of example temperature variations incorporatingsleep data according to example embodiments of the present disclosure.

DETAILED DESCRIPTION Overview

Generally, the present disclosure is directed to health monitoring andwearable devices for health monitoring, such as methods and devices forimproved skin temperature monitoring. In particular, example aspects ofthe present disclosure involve computer-implemented methods forproviding improved skin temperature monitoring. The methods of thepresent disclosure allow for the observation of meaningful changes in aperson's core temperature and the identification of physiological trendsand events relevant to a person's health.

More particularly, a person's skin temperature is expected to changewith shifts in the person's core temperature. At times, there can be apositive correlation between a person's skin temperature and a person'score temperature, while at other times this relationship can result ininverse changes. For example, sometimes a person's body increases itscore temperature to induce fever, and does so by reducing perfusion inthe extremities, so a lower skin temperature is expected while theperson's core temperature is increasing. These physiologically induceddevelopments allow for the possibility of observing trends from acomparison of temperature data streams that may not be possible byobserving other data streams. On the other hand, skin temperaturechanges can also be dominated by shifts in ambient temperature, makingit difficult to identify skin temperature changes associated withphysiological changes. Given this, methods are needed to distinguishskin temperature changes that are physiologically induced from changesthat are environmentally induced.

In view of such challenges, the present disclosure providescomputer-implemented systems and methods for improved skin temperaturemonitoring. In some implementations, the methods of the presentdisclosure involve a computing system determining an internaltemperature of a wearable device worn by a user based at least in parton sensor data from one or more sensors contained within the wearabledevice. In an example, the wearable device may be a wristband, abracelet, a wristwatch, an armband, a ring placed around a digit of theuser, or other wearable products that may be equipped with sensors asdescribed in the present disclosure. As another example, the one or moresensors that measure the internal temperature of the device may becontained within a housing of the wearable device, but may not be inthermal contact with the user's skin. When the one or more sensors thatmeasure the internal temperature of the device are arranged according tothis example, the sensors may be correlated with the user's skintemperature, but may also be more impacted by the temperature of outsideair, for example, as compared to a dedicated skin temperature sensor.

According to another aspect, the methods of the present disclosureinvolve a computing system determining a first estimate of a skintemperature of a user based on sensor data received from one or moreskin temperature sensors in thermal contact with the user and containedwithin the wearable device. In another example, the wearable device caninclude a thermally conductive baseplate configured to be in contactwith the user's skin. In this example, the one or more skin temperaturesensors can be configured to measure the temperature of the baseplate.When the one or more sensors that measure a first estimate of a user'sskin temperature are arranged in this manner, the sensors may be lessimpacted by the temperature of the outside air, for example, as comparedto the internal device temperature sensor described above and/or adedicated ambient air temperature sensor.

According to another aspect of the present disclosure, the computingsystem can estimate an ambient air temperature based at least in part onthe first estimate of the skin temperature and the internal devicetemperature. In some implementations, the computing system estimates theambient air temperature by determining a difference between the firstestimate of skin temperature and the internal temperature of thewearable device. In an example, the estimated ambient air temperaturemay be the product of one or more smoothing or curve fitting processesof data sets corresponding to temperature differentials as describedabove. In some implementations, the computing system may estimate theambient air temperature by processing the first estimate of skintemperature and the internal temperature of the wearable device with amachine-learned model. As one example, the machine learned model caninclude a linear regression model, a neural network (e.g., recurrentneural network), or a clustering model. In some implementations, thecomputing system may receive the ambient air temperature as a predictionoutput by the machine-learned model.

According to another aspect of the present disclosure, the computingsystem can produce an intermediate estimate of skin temperature based atleast in part on the first estimate of skin temperature and the internaldevice temperature. This intermediate estimate of skin temperature canbe further refined based at least in part on the ambient temperatureestimate to aid in generating a second estimate of skin temperature. Inan example, the intermediate estimate of skin temperature may be theproduct of one or more smoothing or curve fitting processes of data setscorresponding to temperature differentials as described above. In someimplementations, the computing system may generate the intermediateestimate of skin temperature by processing the first estimate of skintemperature and the internal temperature of the wearable device with amachine-learned model. As one example, the machine learned model caninclude a linear regression model, a neural network (e.g., recurrentneural network), or a clustering model. In some implementations, thecomputing system may receive the intermediate estimate of skintemperature as a prediction output by the machine-learned model.

In some implementations, the computing system can adjust the ambient airtemperature estimate based at least in part on additional ambient sensordata taken from additional ambient sensors contained within the wearabledevice. In some implementations, the additional ambient sensors caninclude location sensors (e.g., global-positioning sensors),geo-sensors, weather sensors, motion sensors, altitude sensors,altimeter temperature sensors, ambient light sensors, heart ratesensors, and other physiological sensors. In an example, the computingsystem may observe whether an ambient light sensor contained within thewearable device is covered or not covered. In this example, thecomputing system may infer a warmer ambient temperature based on theambient light sensor being covered, which can aid in the determinationof skin temperature estimates and thus physiological trends based onskin temperature, skin temperature changes, and the rate of skintemperature changes. In some implementations, the computing system canadjust the ambient air temperature estimate based at least in part onsleep data of the user collected by the wearable device. In someimplementations, examples of sleep data can include data to indicatewhether the user is awake or asleep, a sleep coefficient of the user,and the heart rate of the user. If the user is asleep, the data can alsoinclude information to indicate whether the user is moving (e.g.,repositioning) and a characterization of the type of sleep the user isexperiencing (e.g., restless sleep, light sleep, deep sleep, rapid eyemovement (REM) sleep). In an example, the computing system may inferthat repositionings of a user during sleep are a function of the user'sthermoregulatory cycle and thus aid in a determination of a user's coretemperature based at least in part on the second estimate of the user'sskin temperature.

According to another aspect of the present disclosure, the methodsinvolve the computing system refining the first estimate of the skintemperature based at least in part on the estimated ambient airtemperature or the intermediate estimate of skin temperature to generatea second estimate of the skin temperature. In an example, the secondestimate of the skin temperature may be the product of one or moresmoothing or curve fitting processes of data sets corresponding to theestimated ambient air temperature. In some implementations, thecomputing system modifies a confidence value associated with the secondestimate of skin temperature or the estimated ambient air temperature.As one example, the confidence value can increase as the temperaturedifferential between the first estimate of skin temperature or theestimated ambient air temperature and the internal temperature of thewearable device decreases. Stated differently, a smaller temperaturedifferential between the first estimate of skin temperature or theestimated ambient air temperature and the internal temperature of thewearable device can equate to greater trust in the second estimate ofskin temperature. As another example, a smaller temperature differentialcan also mean it is less likely ambient temperature is causing changesin the skin temperature of a user.

According to another aspect of the present disclosure, the methodsinvolve the computing system determining one or more physiologicalevents of a user based at least in part on the second estimate of skintemperature. In some implementations, the physiological events mayinclude a fever, a circadian rhythm, a menstruation cycle, ovulation,heat stress, and thermal comfort. Detection of the physiological eventscan include detection or determination of a status of the physiologicalevent such as detection of an onset of the physiological event,determination of an ongoing status of the event, and/or predictionsabout a future status of the event (e.g., peak fever expected to occurin next six hours). In an example, the computing system may detect afever by smoothing a dataset of second estimates of skin temperaturecollected after an elevation in a user's skin temperature.

In some implementations, the computing system can estimate a coretemperature of a user based on the second estimate of skin temperature.In an example, the estimated core temperature of the user may be basedon second estimates of skin temperature collected at varying frequenciesand during different sleep stages of the user (e.g., awake or asleep).In some implementations, the computing system distinguishes coretemperature changes that are physiologically induced from coretemperature changes that are environmentally induced. In someimplementations, the computing system can monitor a rate of change inthe second estimate of skin temperature to detect a transition in thesecond estimate of skin temperature. As one example, the computingsystem can determine physiological events based on the detectedtransition. In some examples, the physiological events may include anonset of fever, a circadian rhythm, a menstruation cycle, ovulation,heat stress, and thermal comfort.

The methods and devices of the present disclosure provide a number oftechnical effects and benefits including the determination of higherconfidence estimates of a person's true skin temperature, observation ofmeaningful changes in a person's core temperature, and theidentification of physiological trends and events relevant to a person'shealth.

The present disclosure also enables the refinement of data received fromsensors within the wearable device by combining and analyzing data frommultiple sensors in a way that allows the user to observe more than justraw data, but also trends and events inferred from the data. In thisway, the present disclosure can also obviate the need for additionalsensors within the wearable device, thereby saving device space andprocessor usage. The present disclosure also allows for more accuratedevices to monitor skin temperature by implementing a device's sensorsin ways that are more efficient, predictable, and useful.

With reference now to the Figures, example embodiments of the presentdisclosure will be discussed in further detail.

Example Methods, Systems, and Devices

FIG. 1 depicts a front view of an example wearable device 100 accordingto example embodiments of the present disclosure. Although the wearabledevice 100 of FIG. 1 is a wristwatch, the systems and methods of thepresent disclosure can be applied to any different type of wearabledevice such as, for example, a wristband, a bracelet, a wristwatch, anarmband, a headband, eyeglasses, an earbud, a ring placed around a digitof a user, items of clothing having computers embedded therein, and/orother wearable products that may be equipped with sensors as describedin the present disclosure. The wearable device 100 may be configuredwith a display 102, a device housing 104, and a band 106.

In some implementations, the wearable device 100 can be configured tocommunicate data to a user via the display 102 and/or any other dataoutput devices such as haptic devices, light emitting diodes, etc. Thedata that is communicated can include data relating to skin temperature,heart rate, sleep state (e.g., light, deep, and REM sleep), sleepcoefficient (e.g., sleep score), and other physiological data of theuser (e.g., blood oxygen level). The display 102 can also be configuredto communicate data from additional ambient sensors contained in or onthe wearable device 100. Example information communicated by the display102 from these additional ambient sensors can include a positioning,altitude, and weather of a location associated with the user. Thedisplay 102 can also communicate data regarding motion of the user(e.g., whether the user is stationary, walking, and/or running).

In some implementations, the display 102 can be configured to displayinformation about physiological events of the user. Examplephysiological events that may be displayed include a fever, a circadianrhythm, a menstruation cycle, ovulation, heat stress, and thermalcomfort of the user. The display 102 can also communicate informationrelating to detection of the physiological events of the user.Configured this way, the display 102 can communicate to the user adetection or determination of a status of the physiological event suchas detection of an onset of the physiological event, determination of anongoing status of the event, and/or predictions about a future status ofthe event (e.g., peak fever expected to occur in next six hours).

The display 102 or other data input device (e.g., various touch sensorsand/or physical buttons, switches, or toggles) can also be configured toreceive data input by the user. Examples of data input by the user caninclude information about symptoms, sleep conditions, ovulation,menstruation, and other physiological information related to the user'shealth.

The device housing 104 can be configured to contain one or more sensors.Example sensors contained by the device housing 104 can include skintemperature sensors, internal device temperature sensors, locationsensors (e.g., GPS), motion sensors, altitude sensors, heart ratesensors, and other physiological sensors (e.g., blood oxygen levelsensors). The device housing 104 can be configured to include one ormore processors.

The band 106 can be configured to secure the wearable device 100 aroundan arm of the user by, for example, connecting ends of the band 106 witha buckle, clasp, or other similar securing device, thereby allowing thewearable device 100 to be worn by the user.

FIG. 2 depicts a rear view of an example wearable device 100 accordingto example embodiments of the present disclosure. The wearable device100 can be configured with a baseplate 202. The wearable device 100 canalso be configured with one or more sensors 204 that can be affixed tothe baseplate 202. Example sensors 204 can include skin temperaturesensors, location sensors (e.g., GPS), motions sensors, altitudesensors, heart rate sensors, altimeter temperature sensors, and otherphysiological sensors (e.g., blood oxygen level sensors). The baseplate202 can be thermally conductive and can be configured to be in thermalcontact with the user and/or skin temperature sensors when the wearabledevice 100 is worn by the user. For example, when worn, the baseplatecan press against the user's skin. Likewise, a skin temperature sensorcan be configured to generate a temperature reading for the baseplate.In this way, the baseplate 202 can be configured to enable a skintemperature measurement of the user when the baseplate 202 is in thermalcontact with the user (e.g., with the temperature of the baseplateserving as a proxy for the skin temperature of the user).

Although some example implementations use a baseplate for reading thetemperature of a user's skin, other approaches can be used as well,including a temperature sensor configured to be in direct contact withthe user's skin. In another example, an infrared sensor can be includedin the device 100 (e.g., within the housing 104) and can measure thetemperature of the user's skin using infrared light. For example, theinfrared light can pass through an aperture in the baseplate 202. Inanother example, one or more temperature sensors can be incorporatedinto the band 106 and can measure the temperature of the user's skin.For example, one or more temperature sensors can be woven into a fabricversion of the band 106.

FIG. 3 depicts a side internal view of an example wearable device 100showing internal device temperature sensor 302 contained within a devicehousing 104 according to example embodiments of the present disclosure.The internal device temperature sensor 302 can be configured to measure,and produce data relating to, a temperature of an internal space of thedevice housing 104 (e.g., an internal device temperature). The internaldevice temperature sensor 302 can also be comprised of multiple internaldevice temperature sensors. The internal device temperature sensor 302may be contained within the device housing 104 of the wearable device100, but is typically not in thermal contact with the user's skin. Inone example, the internal device temperature sensor 302 can be affixedto an interior side of the device housing 104 (e.g., other than thebaseplate 202). In another example, the internal device temperaturesensor 302 can be affixed to a printed circuit board (e.g., the“motherboard”) of the device 100.

FIG. 4 depicts a side internal view of an example wearable device 100showing skin temperature sensor 402 contained within a device housing104 according to example embodiments of the present disclosure. In someimplementations, the skin temperature sensor 402 can be configured to bein physical contact with the user. In this way, the skin temperaturesensor 402 can measure, and produce data relating to, a skin temperatureof the user. In other implementations, the wearable device 100 caninclude a thermally conductive baseplate 202 configured to be in thermalcontact with both the skin temperature sensor 402 and the user's skin.In such an embodiment, the skin temperature sensor 402 can be configuredto measure, and produce data relating to, a temperature of the baseplate202 that is also representative of a temperature of the user's skin. Inyet further implementations, an infrared sensor can be included in thedevice 100 (e.g., within the housing 104) and can measure thetemperature of the user's skin using infrared light. For example, theinfrared light can pass through an aperture in the baseplate 202. Theskin temperature sensor 402 can also be comprised of multiple skintemperature sensors (e.g., multiple different sensors taking multipledifferent approaches as described herein). Other arrangements arepossible as well.

FIG. 5 depicts a flow of steps of an example skin temperature denoisingmethod 500 according to example embodiments of the present disclosure.At step 502, the skin temperature denoising method 500 may determine aninternal device temperature of a wearable device 100 worn by a user. Thedetermination of the internal temperature of the wearable device 100 atstep 502 can be based at least in part on sensor data from one or moreinternal device temperature sensors 302 contained on or within thewearable device 100. In another example, the determination of theinternal temperature of the wearable device 100 at step 502 can be basedat least in part on data from temperature sensors contained within othercomponents of the device 100, such as temperature sensors existingwithin accelerometers and charging circuitry that produce temperaturedata as part of monitoring and calibrating their own output. At a nextstep 504, the skin temperature denoising method 500 may determine afirst estimate of a skin temperature of a user. The determination of thefirst estimate of the skin temperature of the user at step 504 can bebased at least in part on sensor data received from one or more skintemperature sensors 402 in physical and/or thermal contact with the userand contained within the wearable device 100. In another example, thedetermination of the first estimate of the skin temperature of the userat step 504 can be based at least in part on sensor data from one ormore skin temperature sensors 402 in thermal contact with a baseplate202. In this example, the baseplate 202 can also be configured to be inthermal contact with the user's skin when the wearable device 100 isworn by the user.

At step 506, the skin temperature denoising method 500 may estimate anambient air temperature based at least in part on the first estimate ofthe skin temperature from step 504 and the internal device temperatureof the wearable device 100 from step 502. The estimate of the ambientair temperature at step 506 can be based on a determination of thedifference between the first estimate of skin temperature from step 504and the internal device temperature of the wearable device 100 from step502. In another example, the estimate of the ambient air temperature atstep 506 may be the product of one or more smoothing or curve fittingprocesses of data sets corresponding to temperature differentialsbetween the first estimate of skin temperature from step 504 and theinternal device temperature of the wearable device 100 at step 502.

At step 506, the skin temperature denoising method 500 can also producean intermediate estimate of skin temperature based at least in part onthe first estimate of skin temperature from step 504 and the internaldevice temperature of the wearable device 100 from step 502. Thisintermediate estimate of skin temperature from step 506 can be furtherrefined based at least in part on the ambient temperature estimate toaid in generating a second estimate of skin temperature at step 508 ofthe skin temperature denoising method 500. The intermediate estimate ofskin temperature at step 506 may be the product of one or more smoothingor curve fitting processes of data sets corresponding to temperaturedifferentials between the first estimate of skin temperature from step504 and the internal device temperature of the wearable device 100 atstep 502.

In yet another example, the estimate of the ambient air temperature orthe intermediate estimate of skin temperature at step 506 can bedetermined by processing the first estimate of skin temperature fromstep 504 and the internal temperature of the wearable device from step502 with a machine-learned model. In such an implementation, theestimate of the ambient air temperature or the intermediate estimate ofskin temperature at step 506 can be a prediction output of amachine-learned model. For example, the machine-learned model can havebeen trained using a supervised learning approach on a set of trainingdata including pairs of input data and a ground truth label. Forexample, for each pair, the input data can include example skintemperature and internal device temperature readings while the groundtruth label can include a ground truth ambient temperature. For example,the set of training data can be collected over time from situations inwhich the wearable device is operating in an environment with a knownambient temperature. In some implementations, the set of training datacan be generated using sensors existing within a test chamber thatenables control of various temperatures, including temperaturesrepresentative of a user's skin and an ambient environment. By trainingon such a training dataset, the machine-learned model can be configuredto produce a predicted ambient temperature or intermediate estimate ofskin temperature based on the skin temperature and the internal devicetemperature. The machine-learned model can be any form of modelincluding various neural networks (e.g., feed-forward neural networks,recurrent neural networks, transformer networks, etc.), linear models,support vector machines, a clustering model, etc.

In another example, the estimate of the ambient air temperature at step506 can be adjusted based at least in part on additional ambient sensordata taken from additional ambient sensors contained on or within thewearable device 100. In an example, the estimate of the ambient airtemperature at step 506 can be adjusted based at least in part on sleepdata input by the user and collected by the wearable device 100 and/orother ambient data as described herein.

At step 508, the skin temperature denoising method 500 generates asecond estimate of the user's skin temperature by refining the firstestimate of the skin temperature based at least in part on the estimatedambient air temperature or the intermediate estimate of skin temperaturefrom step 506. The second estimate of the skin temperature generated atstep 508 can be the product of one or more smoothing or curve fittingprocesses of data sets corresponding to the estimated ambient airtemperature or the intermediate estimate of skin temperature. In anotherexample, the one or more smoothing or curve fitting processes of datasets can account for minor repositionings of the user, such as occurswhen the user puts on a blanket or takes off a blanket, and othersimilar behavioral factors (e.g., general motion of the user). In thisexample, the one or more smoothing or curve fitting processes can modifya signal of skin temperature data points so that the signal is lessinfluenced by temperature peaks caused by these behavioral factors.

In another example, generating the second estimate of the user's skintemperature at step 508 can involve modifying a confidence valueassociated with the second estimate of the skin temperature or theestimated ambient air temperature. In such an example, the confidencevalue can increase as the temperature differential between the firstestimate of skin temperature or the estimated ambient air temperatureand the internal temperature of the wearable device 100 decreases. Inthis example, a smaller temperature differential between the firstestimate of skin temperature or the estimated ambient air temperatureand the internal temperature of the wearable device 100 can equate togreater trust in the second estimate of skin temperature.

In some implementations, at step 508, the second estimate of the skintemperature can be determined by processing the first estimate of skintemperature from step 504, the intermediate estimate of skin temperaturefrom step 506, and the estimated ambient temperature from step 506 witha machine-learned model. In such an implementation, the second estimateof the skin temperature at step 508 can be a prediction output of amachine-learned model. For example, the machine-learned model can havebeen trained using a supervised learning approach on a set of trainingdata including pairs of input data and a ground truth label. Forexample, for each pair, the input data can include example estimatedskin temperature and ambient temperature readings while the ground truthlabel can include a ground truth skin temperature. For example, the setof training data can be collected over time from situations in which thewearable device is operating in conjunction with a more accurate skintemperature sensor. By training on such a training dataset, themachine-learned model can be configured to produce a refined skintemperature reading (e.g., which reflects physiological events onlyrather than environmental events). In some implementations, the set oftraining data can be generated using sensors existing within a testchamber that enables control of various temperatures, includingtemperatures representative of a user's skin and an ambient environment.The machine-learned model can be any form of model including variousneural networks (e.g., feed-forward neural networks, recurrent neuralnetworks, transformer networks, etc.), linear models, support vectormachines, a clustering model, etc.

FIG. 6 depicts an example physiological events detection system 600according to example embodiments of the present disclosure. In anexample, the physiological events detection system 600 can receive inputin the form of additional ambient conditions sensor data 602, internaldevice temperature sensor data 604, skin temperature sensor data 606,and sleep data 608.

The additional ambient conditions sensor data 602 is optional and caninclude data from location sensors (e.g., global positioning sensors),geo-sensors, weather sensors, motion sensors, altitude sensors,altimeter temperature sensors, ambient light sensors, heart ratesensors, and other physiological sensors (e.g., blood oxygen sensors)contained on or within the wearable device 100. For example, bydetermining the location of the user via the location sensors,information from various databases about local ambient conditions (e.g.,temperature or other weather data) can be obtained and used to guide theprocess. Likewise, data about heart rate and other physiological sensorscan help understand changes in temperature which are physiologicalrather than environmentally driven.

The internal device temperature sensor data 604 can include data fromone more internal device temperature sensors 302 contained on or withinthe wearable device 100. The skin temperature sensor data 606 caninclude data from one or more skin temperature sensors 402 contained onor within the wearable device 100 and in thermal contact with either theuser or the baseplate 202 of the wearable device 100.

The sleep data 608 can include data collected by the wearable device 100or input by the user. Examples of sleep data can include data toindicate whether the user is awake or asleep, a sleep coefficient of theuser, and a heart rate of the user. In this example, if the user isasleep, the sleep data 608 can also include information to indicatewhether the user is moving and a characterization of the type of sleepthe user is experiencing (e.g., restless sleep, light sleep, deep sleep,REM sleep).

In this example of the physiological events detection system 600, thedata inputs 602 and 608 can be processed in combination with theprocessing of data inputs 604 and 606 by performance of the skintemperature denoising method 500. As a component 610 of thephysiological events detection system 600, physiological events of auser can be detected based at least in part on the data inputs 602 and608 and the second estimate of skin temperature generated by performanceof the denoising method 500. In such an example, the physiologicalevents from component 610 can include a fever, a circadian rhythm, amenstruation cycle, ovulation, heat stress, and thermal comfort.

Detection of physiological events 610 can include detection ordetermination of a status of the physiological event such as an onset ofthe physiological event, and/or predictions about a future status of theevent (e.g., peak fever expected to occur in next six hours). In anotherexample, detection of physiological events 610 can involve smoothing adataset of second estimates of skin temperature collected after anelevation in the user's skin temperature.

In component 612 of the physiological events detection system 600, thesystem can infer physiological events. Inferring physiological events atcomponent 612 can involve the one or more processors contained withinthe device housing 104 to cause the display 102 to communicate to theuser information concerning the physiological events detected fromcomponent 610.

FIG. 7 depicts another example of a physiological events detectionsystem 600 according to example embodiments of the present disclosure.In this example, the physiological events detection system 600 canreceive the same inputs 602, 604, 606, and 608 as received in thephysiological events detection system from FIG. 6. The system of FIG. 7can also detect and infer the same physiological events as describedabove for FIG. 6.

The physiological events detection system 600 of FIG. 7 can beconfigured to process the internal device temperature sensor data 604and skin temperature sensor data 606 with a machine-learned model 702.In this example configuration, the machine-learned model 702 can includea linear regression model, a neural network (e.g., a recurrent neuralnetwork), or a clustering model. In such an example, the physiologicalevents detection system 600 can receive an estimate of the ambient airtemperature or an intermediate estimate of skin temperature as aprediction output by the machine-learned model 702. An estimate of theambient air temperature or the intermediate estimate of skin temperaturereceived in this way can also be used to estimate a true skintemperature of a user wearing the wearable device 100. In component 706,the physiological events detection system 600 of FIG. 7 can also beconfigured to detect and monitor transitions (e.g., rate of change) inestimates of the ambient air temperature and true skin temperature ofthe user. In this configuration, the detection of transitions intemperatures at 706 can contribute to the detection of physiologicalevents at component 610 and the inference of physiological events at612.

FIG. 8 depicts another example of a physiological events detectionsystem 600 according to example embodiments of the present disclosure.In this example, the system 600 can receive the same inputs 602, 604,606, and 608 as received in the physiological events detection systemfrom FIGS. 6 and 7. The system of FIG. 8 can also detect and infer thesame physiological events as described above for FIGS. 6 and 7,including inputs relating to the detection of transitions intemperatures from component 706.

The physiological events detection system 600 from FIG. 8 can beconfigured with component 802 to determine a difference between theinternal temperature of a wearable device 100 and a first estimate ofskin temperature of a user wearing the wearable device 100. In component804 of the physiological events detection system 600, the system canestimate an ambient air temperature or an intermediate estimate of skintemperature based on this difference. The estimated ambient airtemperature or intermediate estimate of skin temperature from 804 canalso be used to estimate the effect of the ambient air temperature onthe skin temperature of the user by generating a second estimate of auser's skin temperature. The physiological events detection system 600can also be configured to modify a confidence value associated with thesecond estimate of skin temperature or the estimated ambient airtemperature from 804. In this configuration of the physiological eventsdetection system 600, the confidence value can increase as thetemperature differential between the first estimate of skin temperatureor the estimated ambient air temperature and the internal temperature ofthe wearable device decreases. A smaller temperature differentialdetermined at 802 can also mean it is less likely the estimated ambientair temperature is affecting the second estimate of skin temperature.The second estimate of skin temperature at 802 can also be used toestimate a core temperature of the user. In such a configuration, thephysiological events detection system 600 can distinguish coretemperature changes that are physiologically induced from coretemperature changes that are environmentally induced.

FIG. 9 depicts an example computing system according to exampleembodiments of the present disclosure. The computing system can includea user computing device (e.g., a wearable device 100), which is shown inFIG. 9. The user computing device can in some implementations connect toa server computing system over a network. The server and network are notshown in FIG. 9.

The user device as shown in FIG. 9 can include one or more processorsand a memory. The one or more processors can be any suitable processingdevice (e.g., a processor core, a microprocessor, an ASIC, a FPGA, acontroller, a microcontroller, etc.) and can be one processor or aplurality of processors that are operatively connected. The memory caninclude one or more non-transitory computer-readable storage mediums,such as RAM, ROM, EEPROM, EPROM, flash memory devices, magnetic disks,etc., and combinations thereof. The memory can store data andinstructions which are executed by the processor to cause the computingsystem of FIG. 9 to perform operations. Example operations can includethe flow of steps of the skin temperature denoising method 500 andexecution of component tasks described in the various configurations ofthe physiological events detection system from FIGS. 6, 7, and 8.

The user device of FIG. 9 can also include one or more user inputcomponents that receive user input. For example, the user inputcomponent can be a touch-sensitive component (e.g., the display 102 ofthe wearable device 100) that is sensitive to the touch of a user inputobject (e.g., a finger or a stylus). The touch-sensitive component canserve to implement a virtual keyboard. Example user inputs received bythe computing system of FIG. 9 can include information about symptoms,sleep conditions, ovulation, menstruation, and other physiologicalinformation related to the user's health.

The user device of FIG. 9 can also include one or more sensors,including one or more skin temperature sensors 402 and one or moreinternal device temperature sensors 302. The skin temperature sensors402 and internal device temperature sensors 302 can include negativetemperature coefficient (NTC) thermistors, resistance temperaturedetectors (RTDs), thermocouples, and semiconductor-based sensors.Additional sensors of the computing system of FIG. 9 can be locationsensors (e.g., GPS), motion sensors, altitude sensors, heart ratesensors, and other physiological sensors (e.g., blood oxygen levelsensors). The location sensors may be cellular- or satellite-based GPSsensors. Example motion sensors include passive infrared (PIR),microwave, and dual tech/hybrid motion sensors. Example altitude sensorsinclude pressure altimeters (e.g., aneroid barometers) and radioaltimeters. Example heart rate sensors include optical transmission typepulse sensors (e.g., photoplethysmography (PPG)) and electrocardiography(ECD) sensors.

The server computing system (not shown in FIG. 9) can include one ormore processors and a memory. The one or more processors can be anysuitable processing device (e.g., a processor core, a microprocessor, anASIC, a FPGA, a controller, a microcontroller, etc.) and can be oneprocessor or a plurality of processors that are operatively connected.The memory can include one or more non-transitory computer-readablestorage mediums, such as RAM, ROM, EEPROM, EPROM, flash memory devices,magnetic disks, etc., and combinations thereof. The memory can storedata and instructions that are executed by the processor to cause theserver computing system to perform operations.

In some implementations, the server computing system includes or isotherwise implemented by one or more server computing devices. Ininstances in which the server computing system includes plural servercomputing devices, such server computing devices can operate accordingto sequential computing architectures, parallel computing architectures,or some combination thereof.

The network can be any type of communications network, such as a localarea network (e.g., intranet), wide area network (e.g., Internet), orsome combination thereof and can include any number of wired or wirelesslinks. In general, communication over the network can be carried via anytype of wired and/or wireless connection, using a wide variety ofcommunication protocols (e.g., TCP/IP, HTTP, SMTP, FTP), encodings orformats (e.g., HTML, XML), and/or protection schemes (e.g., VPN, secureHTTP, SSL).

In some implementations, the user device of FIG. 9 can store or includeone or more machine-learned models. For example, the machine-learnedmodels can be or can otherwise include various machine-learned modelssuch as various neural networks (e.g., feed-forward neural networks,recurrent neural networks, transformer networks, etc.), linear models,support vector machines, a clustering model, etc.

In some implementations, the one or more machine-learned models can bereceived from the server computing system over network, stored in theuser device memory, and then used or otherwise implemented by the one ormore processors. In some implementations, the user computing device canimplement multiple parallel instances of a single machine-learned model.

Additionally or alternatively, the one or more machine-learned modelscan be included in or otherwise stored and implemented by the servercomputing system that communicates with the user device of FIG. 9according to a client-server relationship. For example, themachine-learned models can be implemented by the server computing systemas a portion of a web service (e.g., a data augmentation service). Thus,one or more models can be stored and implemented at the user device ofFIG. 9 and/or one or more models can be stored and implemented at theserver computing system. Additionally, some or all operations can becarried out at one location or multiple locations.

Example Data

FIG. 10 depicts a graph of example temperature data of a wearable device100 according to example embodiments of the present disclosure. In FIG.10, temperature measurements of the wearable device 100 are depicted atvarious times and at different states of usage by a user of the wearabledevice 100. FIG. 10 also includes a characterization of the magnitude ofany fluctuations of temperature data and how those fluctuations compareto the time of day and whether or not the user is wearing the wearabledevice 100.

FIG. 11 depicts an example graph of temperature data from internaldevice temperature sensors 302 and skin temperature sensors 402according to example embodiments of the present disclosure. In FIG. 11,temperature measurements of the internal device temperature sensor 302and the skin temperature sensor 402 are depicted at various times and atdifferent states of usage by a user of the wearable device 100. FIG. 11represents recordings of temperature data from both sensors 302 and 402based on the time of day and whether or not a user is wearing thewearable device. FIG. 11 further depicts time periods when thetemperature differential between the measurements of the internal devicetemperature sensor 302 and skin temperature sensor 402 are largest andsmallest. Time periods when the temperature differential between the twotemperature sensors 302 and 402 is smallest (e.g., when the differentialvalue is below a threshold value) are identified and shaded in FIG. 11.The time periods when the temperature differential is smallest alsocorrelate with a higher confidence value in the estimate of a user'sskin temperature, meaning it is less likely ambient temperature iscausing changes in the skin temperature of the user of the wearabledevice 100.

FIG. 12 depicts an example graph of differential temperature data frominternal device temperature sensors 302 and skin temperature sensors 402according to example embodiments of the present disclosure. FIG. 12 isrelated to the graph depicted in FIG. 11, but instead plots a value ofthe temperature difference between the temperature measurements of theinternal device temperature sensor 302 and the skin temperature sensor402. FIG. 12 provides an alternate depiction (e.g., compared to FIG. 11)to illustrate time periods when the temperature differential value islargest and smallest. Time periods when the temperature differentialvalue between the two temperature sensors 302 and 402 is smallest (e.g.,when the temperature differential value is below a threshold value) areidentified and shaded in FIG. 12. As in FIG. 11, time periods when thetemperature differential is smallest also correlate with a higherconfidence value in the estimate of a user's skin temperature, meaningit is less likely ambient temperature is causing changes in the skintemperature of the user of the wearable device 100.

FIG. 13 depicts a graph of example temperature data of multiple wearabledevices 100 according to example embodiments of the present disclosure.In particular, the graph of FIG. 13 plots temperature measurements offuel gauge and skin temperature sensors 402 contained within thewearable devices 100 and how those measurements fluctuate when exposedto defined ambient temperature environments, for defined periods oftime, and whether or not the wearable device 100 is on a wrist of auser.

FIG. 14 depicts a graph illustrating an example linear regression modelof ambient temperature estimate predictions according to exampleembodiments of the present disclosure. In FIG. 14, ambient temperatureestimate predictions are compared against temperature sensor data fromsources including ambient and phantom ground truth sensors (furtherincluding altimeter temperature sensors, skin temperature sensors 402,and internal device temperature sensors 302) over a defined period oftime.

FIG. 15 depicts a graph of example skin temperature variations inrelation to a number of days from a fever according to exampleembodiments of the present disclosure. In particular, FIG. 15 plots thevariation of average skin temperature of a user, in terms of true andsmoothened temperature data, in the days leading up to and following afever.

FIG. 16 depicts a graph of example temperature variations incorporatingsleep data according to example embodiments of the present disclosure.More particularly, FIG. 16 represents recordings of temperature datafrom internal device temperature sensors 302 and skin temperaturesensors 402 contained within a wearable device 100 taken over a definedperiod of time in which periods of sleep and a status of whether or nota user is wearing the wearable device 100 are identified and shaded.FIG. 16 also depicts a count value for internal device and skintemperature sensor measurements taken during the same period of time.

ADDITIONAL DISCLOSURE

The technology discussed herein makes reference to servers, databases,software applications, and other computer-based systems, as well asactions taken and information sent to and from such systems. Theinherent flexibility of computer-based systems allows for a greatvariety of possible configurations, combinations, and divisions of tasksand functionality between and among components. For instance, processesdiscussed herein can be implemented using a single device or componentor multiple devices or components working in combination. Databases andapplications can be implemented on a single system or distributed acrossmultiple systems. Distributed components can operate sequentially or inparallel.

While the present subject matter has been described in detail withrespect to various specific example embodiments thereof, each example isprovided by way of explanation, not limitation of the disclosure. Thoseskilled in the art, upon attaining an understanding of the foregoing,can readily produce alterations to, variations of, and equivalents tosuch embodiments. Accordingly, the subject disclosure does not precludeinclusion of such modifications, variations and/or additions to thepresent subject matter as would be readily apparent to one of ordinaryskill in the art. For instance, features illustrated or described aspart of one embodiment can be used with another embodiment to yield astill further embodiment. Thus, it is intended that the presentdisclosure cover such alterations, variations, and equivalents.

In particular, although FIGS. 1 through 16 respectively depict stepsperformed in a particular order for purposes of illustration anddiscussion, the methods of the present disclosure are not limited to theparticularly illustrated order or arrangement. The various steps of theskin temperature denoising method 500 and the physiological eventsdetection system 600 can be omitted, rearranged, combined, and/oradapted in various ways without deviating from the scope of the presentdisclosure.

What is claimed is:
 1. A computer-implemented method for providing skintemperature monitoring, the method comprising: determining, by acomputing system comprising one or more computing devices, an internaldevice temperature of a wearable device worn by a user based on internalsensor data received from an internal device temperature sensorcontained within the wearable device; determining, by the computingsystem, a first estimate of a skin temperature of the user based on skinsensor data received from a skin temperature sensor contained on orwithin the wearable device; estimating, by the computing system, anambient air temperature based at least in part on the first estimate ofthe skin temperature and the internal device temperature, whereinestimating, by the computing system, the ambient air temperature basedat least in part on the first estimate of the skin temperature and theinternal device temperature comprises: adjusting, by the computingsystem, the ambient air temperature estimate based at least in part onsensor data from at least one of a location sensor, a geo-sensor, aweather sensor, a motion sensor, an altitude sensor, an altimetertemperature sensor, an ambient light sensor, or a heart rate sensorcontained within the wearable device; and refining, by the computingsystem, the first estimate of the skin temperature based at least inpart on the estimated ambient air temperature to generate a secondestimate of the skin temperature.
 2. The computer-implemented method ofclaim 1, further comprising determining, by the computing system, one ormore physiological events based at least in part on the second estimateof the skin temperature.
 3. The computer-implemented method of claim 2,wherein the one or more physiological events include at least one of anonset of fever, a circadian rhythm, menstruation cycle, ovulation, heatstress, or thermal comfort.
 4. The computer-implemented method of claim2, wherein determining, by the computing system, the one or morephysiological events based at least in part on the second estimate ofthe skin temperature comprises: estimating, by the computing system, acore temperature of the user based at least in part on the secondestimate of the skin temperature; and distinguishing, by the computingsystem, user core temperature changes that are physiologically inducedfrom user core temperature changes that are environmentally induced. 5.The computer-implemented method of claim 2, wherein determining, by thecomputing system, the one or more physiological events based at least inpart on the second estimate of the skin temperature comprises:monitoring, by the computing system, a rate of change in the secondestimate of the skin temperature to detect a transition in the secondestimate of the skin temperature; and determining, by the computingsystem, the one or more physiological events based at least in part onthe detected transition in the second estimate of the skin temperature.6. The computer-implemented method of claim 1, wherein estimating, bythe computing system, the ambient air temperature based at least in parton the first estimate of the skin temperature and the internal devicetemperature comprises: determining, by the computing system, adifference between the first estimate of the skin temperature and theinternal device temperature; and estimating, by the computing system,the ambient air temperature based at least in part on the differencebetween the first estimate of the skin temperature and the internaldevice temperature.
 7. The computer-implemented method of claim 1,wherein estimating, by the computing system, the ambient air temperaturebased at least in part on the first estimate of the skin temperature andthe internal device temperature comprises: processing the first estimateof the skin temperature and the internal device temperature with amachine-learned model; and receiving the ambient air temperature as aprediction output by the machine-learned model.
 8. Thecomputer-implemented method of claim 1, wherein estimating, by thecomputing system, the ambient air temperature based at least in part onthe first estimate of the skin temperature and the internal devicetemperature comprises: adjusting, by the computing system, the ambientair temperature based at least in part on sleep data of the usercollected by the wearable device.
 9. The computer-implemented method ofclaim 1, wherein refining, by the computing system, the first estimateof the skin temperature based at least in part on the estimated ambientair temperature to generate the second estimate of the skin temperature,comprises modifying a confidence value associated with the secondestimate of the skin temperature.
 10. The computer-implemented method ofclaim 9, wherein modifying the confidence value associated with thesecond estimate of the skin temperature comprises increasing theconfidence value as a temperature differential of the first estimate ofthe skin temperature and the internal device temperature decreases. 11.The computer-implemented method of claim 1, wherein: the internal devicetemperature sensor contained within the wearable device is comprised ofmultiple internal device temperature sensors; or the skin temperaturesensor contained on or within the wearable device is comprised ofmultiple skin temperature sensors.
 12. A wearable device, comprising: adevice housing configured to be worn by a user; one or more processorsincluded within the device housing; one or more skin temperature sensorsincluded on or within the device housing and configured to produce skintemperature sensor data; one or more internal device temperature sensorsincluded within the device housing and configured to produce internaldevice temperature sensor data; and non-transitory computer-readablememory included within the device housing and storing instructions that,when executed by the one or more processors, cause the wearable deviceto perform operations, the operations comprising: determining aninternal device temperature within the device housing based at least inpart on the internal device temperature sensor data received from theone or more internal device temperature sensors contained within thewearable device; determining a first estimate of a skin temperature ofthe user based on the skin temperature sensor data received from the oneor more skin temperature sensors included on or within the devicehousing; estimating an ambient air temperature based at least in part onthe first estimate of the skin temperature and the internal devicetemperature, wherein estimating the ambient air temperature based atleast in part on the first estimate of the skin temperature and theinternal device temperature comprises: adjusting the ambient airtemperature estimate based at least in part on sensor data from at leastone of a location sensor, a geo-sensor, a weather sensor, a motionsensor, an altitude sensor, an altimeter temperature sensor, an ambientlight sensor, or a heart rate sensor contained within the wearabledevice; and refining the first estimate of the skin temperature based atleast in part on the estimated ambient air temperature to generate asecond estimate of the skin temperature.
 13. The wearable device ofclaim 12, wherein the operations further comprise continuously observinga core temperature of the user, the core temperature of the user basedat least in part on the second estimate of the skin temperature.